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ATTRACTION TIME FOR STRONGLY REINFORCED WALKS 

By Codina Cotar and Vlada Limic^ 

TU Berlin and CNRS 

We consider a class of strongly edge-reinforced random walks, 
where the corresponding reinforcement weight function is nondecreas- 
ing. It is known, from Limic and Tarres [Ann. Probab. (2007), to ap- 
pear], that the attracting edge emerges with probability 1 whenever 
the underlying graph is locally bounded. We study the asymptotic be- 
havior of the tail distribution of the (random) time of attraction. In 
particular, we obtain exact (up to a multiplicative constant) asymp- 
totics if the underlying graph has two edges. Next, we show some 
extensions in the setting of finite graphs, and infinite graphs with 
bounded degree. As a corollary, we obtain the fact that if the rein- 
forcement weight has the form ■w{k) = k'' , p > 1, then (universally 
over finite graphs) the expected time to attraction is infinite if and 
only if p<l + i^. 

1. Introduction. Let ^ be a locally finite graph with the edge set E{Q) 
and the vertex set V{Q). We will assume without further mention that G is 
connected. We call any two vertices u, v connected by an edge adjacent (or 
neighboring); in this case, we write v and denote by {u,v} = {v,u} the 
edge connecting them. We will denote by 

1^1 = 1^(6^)1 
the number of edges of Q and by 

#s = \v{g)\ 

the number of vertices of Q. Finally, we denote by D{g) = sup^gy(g) degree(?;) 
the degree of Q, where, for any v G V{g), degree(f) equals the number of 
edges incident to v. 
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Let (^o,e G E{Q)) be given integers and assume that ^[j > 0, e G E{Q). 
Given a reinforcement weight function w : {0, 1, 2, . . .} i— s- (O,cxo), the edge- 
reinforced random walk (ERRW) on Q records nearest neighbor step tran- 
sitions of a particle in V{Q). That is: 

(i) if currently at vertex v € V{Q), in the next step, the particle jumps to 
a vertex u S V{Q) adjacent to v; 

(ii) the probability of a jump to u is w- proportional to the number of pre- 
vious traversals of the edge {f,u}. 

The more formal definition is as follows. If is a finite graph, it seems nat- 
ural, from the point of notation, to construct and study the edge-reinforced 
random walk started at the initial time 

to:= E ^o>0; 
eeE{g) 

a process starting at time is obtained by a time shift. If Q is an infinite 
graph, we simply set to := 0. Denote by the (random) position of the edge- 
reinforced random walk at time n. Then, Itg G ViQ) is the initial position 
and {In,In+i} £ E{Q) for all n > t^, almost surely. Let J^n be the filtration 

(1) = a{h,k = 0, . . . , n, [to, e G E{g))}. 

Moreover, the dynamics of the edge-reinforced random walk is prescribed 
according to the rule 

I^[In+l - V\J-n)l{I„=u} - — f ^ i^{I,,=u,u^v}, 

where, for any e G E{g), 

n—l n—1 

(^) -^n ~ ^0 ~^ E/ ^{<^ was traversed at ith step} — ^0 ~^ E/ '^{{hji+i}=e} 
i=to i=to 

equals the initial weight Iq incremented by the total number of (undirected) 
traversals of edge e prior to time n. Note that to is chosen so that whenever 
V{Q) < oo, J2eeE{g) -^k ~ ^ ^ — ^O; almost surely. The starting weights 

:= £q are specified as deterministic above, but one could use random vari- 
ables instead in applications and definition (1) accounts for this possibility. 
Our results would then hold conditionally on the starting weights. 

We denote by Qi the range of the edge-reinforced random walk on Q. 
More precisely, we let 

gi = {vigi),E{gi)) 

be the random subgraph of G where, for any v G V{Q), we have 
V G V{Qi) <J4> 3n > to such that /„ = v, 
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and, for any e € E{Q), 



such that {In,In+i} = e. 



Apart from the behavior analogous to recurrence or transience of Markov 
chains (see, e.g., [7, 9] or [10], Theorems 5.2 and 5.6), ERRW may exhibit a 
very different asymptotic behavior as time increases. For example, it is easy 
to see, [5, 11], that the assumption 



to have probability 1, whenever D(Q) < oo. It is easy to find examples of 
locally bounded trees with D(G) = oo such that (AO) holds but Gi is infinite 
with positive probability. Sellke [11] provides (slightly peculiar) examples of 
edge-reinforced random walks on Z where '^k^/''^i^) finite over even k 
and infinite over odd k, but where Qi is still a finite graph, almost surely. 

Next, we briefly discuss links between our work and the recent literature. 
For a detailed review of a number of interesting results on edge-reinforced 
random walks, we refer the reader to a recent survey of Pemantle [10] on 
stochastic reinforcement processes. 

A result of Sellke [11] (the argument is also described in detail in [5], 
Section 2) implies that (AO) is sufficient and necessary for 

(3) P(the walk ultimately traverses a single edge) = 1, 

whenever the underlying graph is bipartite and of bounded degree. Limic 
[5] proves that (AO) implies (3) on any graph of bounded degree, where 
the reinforcement weight is a reciprocally summable power function. In a 
recent work, Limic and Tarres [6] show that for a fairly general class of 
reinforcement weights [in particular, whenever w is a nondecreasing function 
satisfying (AO)] (3) holds on any graph of bounded degree. We will refer to 
any weight w satisfying condition (AO) as strong and to the corresponding 
ERRW as a strongly reinforced walk. 

The current paper assumes the setting of [6] and is devoted to the study 
of the tail behavior of the time of attraction 



(AO) 




< oo 



is sufficient for the event 



{Qi is a finite graph} 



T = infjA; > : 3e G E{g) such that V/ / eX/ 



/ _ 



= max 

m>k 



(4) 



inf{A: > : {/„, = I„+2}, Vn > k} 



that is, the first time after which only the attracting edge is traversed. This 
random variable is an important statistic, useful for applications (e.g., [3] 
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or [4]). In this paper, we make a few connections to the hterature on the 
behavioral science of social insects and refer the reader to [10] for a diverse 
list of potential applications. 

It is clear that the sequence of tail probabilities {P{T > k),k> 1) de- 
pends on the structure of the underlying graph Q, the weight function w, 
the initial weights Iq and the initial position Jt^. However, the results of 
Sections 3.1-3.2 verify an interesting universality-type behavior. Namely, 
fix w satisfying (AO), let Q be an arbitrary finite graph with some pre- 
scribed initial edge weights and initial position, and let Q' be the simple 
two-edge graph from Section 2 with initial weights equal to 1 on both edges. 
Then, if (resp., P^'^) denotes the law of the corresponding ERRW on 
Q (resp., Q'), the asymptotic order of magnitude of P^(T > A;) is induced 
by that of P^'^{T > k). To some extent, this also holds on infinite trees of 
bounded degree; see Corollary 18. 

Definition 1. For sequences a^, 6^ of real numbers, we write Uk bk if 
and only if 

— ^ € [c, C] , k>l for some c, C G (0, oo) . 
h 

The rest of the paper is organized as follows. Section 2 is devoted to the 
careful study of the two-edge setting. In particular, in Section 2.1, we prove 
Corollary 5, stated less precisely as follows. If we assume that E{Q) consists 
of two elements and let 

Zoo ■= #{times the nonattracting edge is traversed}, 

then, under assumption (AO), 

w{t) 

A stronger statement, due to R. Pemantle (personal communication), 

(5) lim w{i)P{Zoo =i)e (0, oo), 

holds in this simple setting. The limit will become apparent in the course of 
the proof sketched at the end of Section 2.2. 

Lemma 6 of Section 2.3 provides the initial order-of-magnitude estimates 
on the tail probability P{T > k) as A; — > oo. More precisely, we prove that 

1 ^ wjk + j-e) 

w{k - £) j-}^ w{k + + w{e + 1) 

1 - w{j + i-l) 

^(^) /=o +£-l) + w{k + l-i) ■ 



p(r>n)x y: E 



k=n+'\ P<h.l'). 
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Such an expression seems awkward for applications and we work further to 
find simphfications. In particular, Theorem 9 shows simpler looking asymp- 
totics of the tail distribution of T, under the additional assumption (Al) that 
u; is a nondecr easing function. The main idea is simple: the event which with 
overwhelming probability contributes to the event {T = k + 1} of interest is 
the one where at time k, the weaker edge (i.e., the edge with the lower cur- 
rent number of traversals) is traversed and at all future times, the stronger 
edge is traversed. Therefore {Z^ denoting the number of traversals of the 
less traversed edge at time k), 

p(r = t + 1) X E^p(z. = ,)_^-^|L_p(z„ = < + 1 |z.« = (' + 1). 

For i close to k/2, it is plausible that P{Zk = (-) is sufficiently small so that 
the contribution in the above sum vanishes asymptotically. For (. small, the 
middle term w{i)/{w{k — i) -\- w{i)) is again small. In order to estimate 
the above sum well, one then needs to find the interval of indices i which 
make up the bulk of the contribution. As shown in Proposition 2, P{Zi^ = 

^) ^w^k-\')w'(e) ' ^® plausible that the overwhelming contribution to 

the sum comes, approximately, from the range of indices where P{Zoo = 
^ + = £ + 1) X 1. For formal estimates, see Section 2.3. 

In Section 2.4, we include specific calculations for cases of w that have 
already been used (or might be used) in applications (see [2, 4]) that satisfy 
the assumptions (AO)-(Al). In particular, we paraphrase as follows. 

Theorem 10(a). Ifw{k) = kP for some fixed p > 1 and if p' = {p — l)/p, 
then 

P{T>k)-—^. 
In particular, E{T) is infinite if p <1 + and finite if p>\+ "^^2^ ■ 

This type of result should be particularly interesting for applications. In 
fact, in [4], for a similar model, the reinforcement weight is set to w{k) = k^ 
and real-life data is compared to different values of p and initial configura- 
tions. More precisely, the authors study a colony of ants which randomly 
explores a chemically unmarked territory, starting from its nest. The ex- 
ploration is carried out on two branches A and B. Initially, both branches 
are equally likely to be chosen. However, each ant that passes along one 
of the two branches leaves an additional pheromone mark and in this way 
infiuences the following ant's decision in choosing A oi B. In the real- life 
experiment, it is observed that, after initial fluctuations, one of the two 
branches becomes more or less completely preferred to the other. In their 
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(reinforcement) model, k represents the number of ants that have chosen a 
particular branch and p determines the degree of nonlinearity. The model is 
used for further study of the explorer movement pattern in two-dimensional 
space. 

Section 3 is devoted to analysis on general graphs of bounded degree. 
In particular, we are interested in a universality- type behavior of the tail 
distribution P^{T > •) over graphs once the reinforcement weight func- 
tion w is fixed. In the course of our analysis, we also obtain exponential 
bounds (see Lemma 25) on the tail distribution of \Qi\ and, in particular, 
some information on the distance of the attracting edge from the start- 
ing point. Providing a universal lower bound on P^{T > •) in terms of the 
corresponding quantity in the two-edge graph setting turns out to be sim- 
ple (see Lemma 12); however, finding an analogous upper bound is not as 
simple. Section 3.1 is devoted to analysis on trees. Here, initial universality- 
type behavior is demonstrated using comparison (coupling) arguments. Sec- 
tion 3.2 is devoted to the finite graph setting. By generalizing the technique 
of Section 2, a fairly general universality-type behavior is shown, under the 
additional assumption (A2). Finally, Section 3.3 discusses extensions to the 
infinite graph setting. 

In the remainder of the paper, we assume that all edges have ^^trivial" 
initial weight I'q = 1, unless otherwise specified. Also, we will denote by a A 6 
(resp., a V 6) the minimum (resp., maximum) of two numbers a and b, and 
by [aj , the integer part of a number a. 

2. Two-edge case. The ERRW on graph Q that contains only two edges 
is the prototype model of interest. Several interesting qualitative features, 
specific to edge-reinforcement with particular reinforcement weight function 
w, are already observed and are usually relatively easy to verify. This process 
also corresponds to a generalized urn model; see, for example, [1] or [11]. A 
recent study by Oliveira and Spencer [8] concerns finer properties of this urn 
model in the case where w{k) = for some p>l. 

We will initially assume that Q contains two vertices, and 1, and two 
edges, green and red, connecting them. We abbreviate 

v green r> \^re(i 

n • — -^n 1 ^i^i • — n 

In the remainder of this section, we also assume that the initial configuration 
on the two edges is G2 = i?2 = 1, unless otherwise specified. We use the 
notation P"'* for the law of the system with the initial configuration Ga+h = 
a, Ra+b = b. When there is no risk of confusion, we simply use P for the law 

The other natural choice of a graph with two edges is the one spanned 
by three vertices, —1,0 and 1, with a green edge that connects and — 1 
and a red one that connects and 1. In the study of this model, we mainly 



ATTRACTION TIME UNDER STRONG REINFORCEMENT 



7 



concentrate on the case where the initial weights a and b are of opposite 
parity. We denote by P"'* the law of the ERRW on the two-edge graph 
spanned by —1,0 and 1, started (without loss of generality) at the initial 
position 0. Note that the study of P"''' is necessary as it will be needed later 
for the subsequent analyses of the time of attraction of the ERRW on trees 
and on finite graphs. The main results in Section 3 are expressed in terms 
of both P"''' and P"'^ 

Observe that under P'*''', we have Ga+b = o.,Ra+b = b and Ga+b+2j — 

Ga+b+2j~2 £ {0, 2}, Ra+b+2j — Ra+b+2j~2 + Ga+b+2j — Ga+b+2j~2 = 2 for all 

i>i. 

2.1. Some preliminary estimates. Due to monotonicity, Poo := limfc-^oo Rk 
and Goo := limfc-^oo Gk exist almost surely as (0, oo]-valued random variables. 
Define 

Zk =min{Gfc,Pfc}. 
Note that < Z^+i and that the limit 
(6) ^oo := lim Z^ = Poo A Goo 

fe— >oo 

is an almost surely finite random variable since the reinforcement is strong. 

-l)+w( 
v{k-l) 



Proposition 2. Define c := maxfc>2( "'^^~^^+"'^^^ ' 



(a) For any 1 < £ < |, we have 

(b) For any i>l, we have 

c vu[£) w{i) 

Note that the lower bounds are interesting only for strongly reinforced 
walks, where P{Zoo < oo) = 1 and P{Zoo = 1) > 0. A careful reader of the 
proof will note that all of the above inequalities are strict; however, we do 
not anticipate any use of this fact. 

Proof of Proposition 2. We will prove the upper bounds by induc- 
tion and the lower bounds will follow in a similar way, as indicated at the 
end of the proof. First, note that for i < ^ — 1, 



P{Zk = i) = PiZk. 



2 

w{k-i-l) 



w(k - i - 1) + w(i) 
(7) 

+ P(^.-i=^-l) "^'-'^ 



w{£ - 1) + w{k - e) 
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Similarly, we also have, in the special case k = 2£, 

(8) P(Z2,=£)=P(Z2,_i=^-l) 



w{l-l)+w{l) 
and in the special case A; = 2£ + 1, 

(9) P{Z2t+l=l) = P{Z2l = l) + P{Z2l = l-l) ^ ' 



w{i - 1) + w{i + ly 

Since any probability is bounded by 1, we have, trivially, 

p{Zk = 1 < w{i) \ 

W[K — 1)W[1) 

an observation that will be used in the base and in each step of the induction. 

The base of induction is the case i = l, k = 2£-\-l = 3 and the statement 
here is trivial, as noted above. 

Let us now assume that the upper bound inequalities in the statements 
(a) and (b) of the theorem hold for alH < A; — 1 and ^ < §• For the induction 
step, we need to show that the bounds hold for i = k and ^ < |. 

Suppose, first, that £ < [|j — 1. Then, by (7) and the induction hypothesis, 
we have 

P(7 -f^<^^^!!i:^- (, Mk-i) + w{i) 

^ ' - w{i) ^ wik - i) ^ 'w{k-£)w{i)- 
For the two atypical cases k = 2i and k = 2£ -\- 1, we have, similarly, by (8), 

PiZ^e = £)= P{Z2,^, = £ - 1) < 



w{£-l)+w{£) w{£) 
and by (9), 

^ , ^^(1) ,^, w{£)+w{£ + l) 

P[Z2l+l=£) < —T-r + = W{1) . 

w[£) w[£ + l) w{£)w[£ + l) 

The proof of the lower bounds is symmetric. Note that P{Zk = 1) > 
P{Zoo = 1) and the choice of c was precisely made so that the lower bound 
holds both in (a) for any A; > 3 and ^ = 1, and in (b) for £ = \. Given these 
initial bounds, the above argument by induction on k will carry over to yield 
the lower bound of (a) and (b). □ 

The result above under the law P^'^ generalizes to the setting of the law 
P^'^ on a two-edge graph with three vertices, in the following way. 

Proposition 3. Define 

'w{k)+w{l)\ /w(k)+w(2) 
c := max -— V max ' " ' 



k>2 cvcn\ w{k) ) k>l odd\ w(k) 
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For any k>l, 1 < o,e <2k such that o is odd, e is even and o + e = 2k + l, 
we have 



P'^\G2k+i = o, R2k+i = e)< {w{l) V w{2))- 



w{o)w{e) 
and 

w{l)Aw{2) w{o)+w{e) ^ -^.^ _ ,^ ^ pi,2(^ _ ^ 

c w[o)w[e) 

Proof. We abbreviate P^'^ as P. First, we concentrate on the upper 
bound. If either o = 1 or e = 2 (or both), the upper bound is trivial, so the 
base of induction is verified. Now, as in the previous proposition, if both 
o > 1 and e > 2, we apply the induction step using 

P{G2k = o, R2k = e)= P{G2k^2 = o - 2, i?2fc-2 = e) ""^^ " 



+ P{G2k-2 = o,R2k-2 = e-'i) 



w{o — 2) + vj{e) 
w{e-2) 



w{o-2) + w{e-2)' 



_ Similarly, note _that P^'2(G2fc+i = l,i?2fc+i = 2A;) > P^''^{Goo = j) = 
P^'HZ^ = j) and pi'2(G2fc+i = 2k-l,R2k+i = 2) > P^^^Roo = 2) = P^'^Z^ 
2), so the lower bound holds for any k>l whenever o = 1 or e = 2, with the 
above choice of c. Given these initial bounds, one applies the induction step 
once again to prove the general lower bound. □ 

Moreover, using the same technique as above, one arrives at the following 
general result. 

Theorem 4. Let a,b>l and define 

I h\- I h \ f w{k - a) + w{a)\ 
c{a, b) = c{a, b, w) := rnax 

k>a+b\ w[k — a) / 

and 

f wik)+wia) \ f w{k)+w{b) \ 

c{a,b) = c(a,b,w) := max V max . 

fc>6,fc cvcnV w{k) ) k>a,k odd\ / 

Then, for any k>a + b and l>aAb, we have 

^(") pa,b(y _. Mk-i)+ W{1) _ Wjk -e)+ Wji) 
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and, assuming that a is odd while b is even, 

w{a)Aw{b) yr _ w{k-e) + w{e) 

-c{a,b) J^l/ w{k-l)w{i) 

These pre-asymptotic estimates will be useful in further analysis. 
Before continuing, we note that a direct consequence is the following re- 
sult, already mentioned in the Introduction. 

Corollary 5. Assuming (AO), under any of the laws from Theorem 4, 
there exist c,C (z (0, oo), depending on the choice of the law, such that 

c C 



w{iy w{i) 



2.2. The ''time-line^' construction. Here, we briefly recall the construc- 
tion of the edge-reinforced walk using independent families of exponentials; 
see [1, 11] or [5]. In the current work, we will use it mainly in the context 
of trees. To simplify the notation, we focus on two cases, where Q is either 
a two-edge graph or a "star" with m fingers. The reader can easily handle 
the general case. 

First, assume that Q contains two vertices, and 1, and two edges, ec and 
eij, connecting them. Fix initial weights i'^ = a and = b, and let Itg = 0, 
where tQ = a + b. Note that the corresponding edge-reinforced random walk 
has the law P"'*. 

For each k >1, let E^, be exponential [rate w{k)] random variables 
and let {E^, > 1}, {Ej^, > 1} be two independent families of independent 
random variables. Let 

(10) T^ := ^ ■= X! ^b+k- 

k>0 k>0 

Note that and T^ are independent and finite [due to (AO)] almost surely. 
In Figure 1, intervals between subsequent dots have length E^_^_f^ or E^_^_f^, 
corresponding to the edge and to the index of the chronological order k, and 
the hmits T^, are also indicated. 

One can construct a realization of the edge-reinforced random walk on G 
from the above data, or (informally) from the figure, as follows. 

Find the minimum of E^ and E[^ by "simultaneously erasing at rate 1 
in the chronological direction" the time-lines corresponding to both edges 
until the first dot is encountered. In the figure, this happens to be the first 
dot on the time-line corresponding to edge ec, that is, E^ < E^. Thus, 
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the particle moves from to 1, traversing the edge cq in the first step. 
Note that, due to the properties of exponentials, the probability of this 
move is exactly w{a)/{w{a) +w{b)). Continue by simultaneous erasing (the 
previously unerased parts of) time-lines corresponding both edges until the 
next dot is encountered. In the figure, it appears on the time-line of cr. 
Hence, the particle traverses the edge cr in the second step to go back from 1 
to 0. Due to the memoryless properties of exponentials, the (residual) length 
of the interval until the first dot on the time-line of cr is again distributed 
as an exponential [rate w{b)] random variable, independent of all other data. 
Therefore, the probability of this transition [namely, w{b) / {w{b) + w{a + 1))] 
again matches that of the edge-reinforced random walk. Continue the above 
procedure of simultaneous erasure of the time- lines. In this way, the steps of 
the corresponding edge-reinforced random walk are generated inductively. 

As its byproduct, a "continuized" version of the edge-reinforced random 
walk arises: here, the particle makes the jumps at exactly the times when 
the dots are encountered. If we denote the position of the particle (in the 
new process) at time s by I{s), and if tq = and < ti < r2 < • • • are the 
subsequent jump times of the particle, then the discrete-time edge-reinforced 
random walk constructed above and its continuized version are coupled as 
follows: 

Ik = I{Tk), k>0. 

One typically says that I is the skeleton process of /. 

Now, let ^ be a labeled tree with the central vertex which is connected 
via edge ej to each leaf vertex i, i = 1, . . . ,m. We call such G a star with 
m fingers. Fix initial weights = and let = 0, where to = Z^E^i^o- 
In particular, note that if m = 2 and Iq = a, £q = 6, then the corresponding 
edge-reinforced random walk has the law p"-^^. 

Similarly to the previous construction, for each i = 0, . . . ,m and k > 
1, let E^, be an exponential [rate w{k)] random variable and let {£'|,i = 
0, . . . , m, A; > 1} be a family of independent random variables. Define 

k>0 

The multiple "2" in the subscript comes from the fact that the particle 
traverses each edge twice before coming back to the central vertex. Again, 



time-line of 

► ec 

oc 

■ " eR 



Fig. 1. The time-lines of a two-vertex graph. 
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note that the above m random variables are continuous, independent and 

finite alrnost surely. In Figure 2, intervals between subsequent dots have 
length Eli , for the corresponding i and k. 

One constructs a realization of the corresponding edge-reinforced random 
walk from the above data analogously to the two-edge setting, the only 
difference being that now, in every second step, when not at the central 
vertex 0, the particle jumps almost surely back to 0. From the above figure, 
one can read off the first four steps of the walk as Ito+i = 1, -^to+i = 0^ 
Ito+i = 2 and Ito+i = 0. The reader will quickly verify that, due to the 
properties of exponentials, the probability of transitions match those of the 
edge-reinforced random walk. 

Again, a continuized version of the edge-reinforced random walk emerges, 
where there are various possibilities to account for the "singular" behavior 
of the walk at the leaves of Q. For example, one could use the random 
variables E^^i^2k+i (^^^^ ^^'^ ^^"^^ pl&y role in the construction of the 
walk) as subsequent waiting times at the leaf i for each i = 1, . . . ,m. 

Proof of (5). We concentrate on the case P = P^'^ and show that 
the limit in (5) equals 2 f{x)'^dx, where / is the (continuous) density 
of Tg = EfcLi E^. Let Sf := Ei=\ and fi be the density of Sf. Then, 
since P(Zoo =i) = P{Goc = i) + P{Roo = i) = 2P{R^ = ^), by symmetry, 
we have 

w{l)P{Z^ =£) = 2w{E)P{Sf <Tg< S^_,,) 

= 2w{i)E{^s^^Ta}P{S^+,>Tg\S^,Tg)) 



(11) 

= 2w{i)E{l^sr^^TG}e 



-w{l){Tg-Sfh 



roo rt 

= 2 / dtf{t) / d5/,(5)^(£)e-"'W(*-^), 
Jo Jo 

where the first identity is clear from the graphical construction above, the 
second is a simple conditioning relation, the third uses the fact that S*^^ — 

timc-linc of 

I . . . ► ei 



62 





Fig. 2. The time-lines of a star with m fingers. 
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= is exponential [rate w{i)], independent of the cr-field generated by 
S^,T^, and the last is the same expression written in terms of densities of 
and T^. 

In order to prove that the integral in (11) converges to f{x)^dx, it 
suffices to show that, as ^ — > oo, 

(12) f'dsMs)w{e)e-^^'^^'-''^^f{t) 



and that the left-hand side above is uniformly bounded in i and in t. In fact, 
fi^s) is bounded by a fixed constant in both I and s, as a convolution of an 
exponential and another density. Moreover, 

\fe{si) - fiis2)\< J \fi{si - u) - fi{s2 - u)\gi{u) du, 

where fi is the (exponential) density of Si and g£ is the density of — Si- 
We conclude that {fi,i > 1) is a uniformly continuous family of functions. 
The convergence in (12) is now not difficult to show, by writing fi{s) = 

(Ms) - Mt)) + ifdt) - fit)) + fit) and using the fact that Sf /T^^Tg, 
as well as wii) ^ oo, so that the integral concentrates around t as £ — > oo. 

Note that one can modify the above proof to show an analogous state- 
ment under any law P"^'^, a,6 > 1, by instead using Sf := X]fc=i-^fc') •= 

Ei=fe^^, Tg := Efc>o^?+fc and T« := Efc>o^6+fc- Namely, one can easily 
verify, using the above method, that 

hm wii)PiZ^ =i) = 2[fTG it)fTR it) dt, 

where fj'G and frpR are densities of Tg and Tg, respectively. □ 

2.3. Time of attraction. Next, consider the time of attraction 
T := min{A; >l:Zi = Z^+i, for all / > k}. 
Note that {T = A; -|- 1} is a disjoint union of j4| and , where 
Af. = {the less (or equally) traversed edge is chosen 

at time k and the remaining edge is chosen at all later times}, 
= {the more traversed edge is chosen at time k 

and the remaining edge is chosen at all later times}. 
Given {Z^ = i} for some i < k/2, the event A| happens with probability 



wi£) + wik - £) M. wij -i) + wie + 1) 

J—K 



14 C. COTAR AND V. LIMIC 

while happens with probabihty 



w{k-£) -p- w{j) -w{k)c 

^ ' w{k-e)+w{l)^}w{3)+w{k-£+l) 

3 



Finally, if 2t = A;, then P{Al\Zk = i) is an expression analogous to (13), 

fr - k/2) 

^}^w{j-k/2)+w{k/2 + l)- 

It will be useful to abbreviate 

w{k + j-£) 
^JoWik + j-i) + w{e)' 



Wk{i) ■■= n 

(15) 



oo 



^J-^w{k + 2j-e)+w{£)- 
Note that if e<k/2, then 

(16) Wk{i) = P{Z^=£\Zk=£). 
The identities (13)-(15) then yield 

(17) P{Ai\Z,=£)= VF,.+i(£ + l), £<k/2, 

w[£) + w{k — l) 

(18) P{Ai\Zk=£)=Wk+i{k/2 + l), k = 2i, 

(19) P{At\Z, =£) = -^^^tzA^^Wk+iik + l-£) 

w[k — £) + w[£) 

and similar identities hold under the laws P""'^ and P""'^ (with W used in 
place of W) for a,b>l. 

We have, as discussed above, 

\k/2]-l 

PiT = k + l)= P{Zk = 3){P{Ai\Zu=3)+P{Al\Zu=j)) 

+ P{Zk = k/2)P{Al\Zk = k/2). 

Now, (17)-(19), together with Theorem 4, imply the following asymptotic 
formula. 

Lemma 6. Under the law P"^'^, we have 

^ 1 ,„ . 1 



P{T = k + l)^ 

e=aAb 



Wk+i{£+l) + ^Wk+i{k + l 



w{k-£) ' w{£) 
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Similarly, under p°-^^ ^ where a is odd and b is even, and when k is odd (since 
the initial time is a + b and the initial position is 0), 

PiT = + 2) X Y. + ^> + , £ Mhf"-''^' + 

£=a,odd ^ ' l=b,even ^ ' 

From now on, we will also assume that 
(Al) wiji) is nondecreasing in k. 

This will be useful for future estimates since we then have the following. 

Lemma 7. (a) For each A; > 1, Wfc(-) is a nonincreasing function on the 
interval [1, k/2]. 

(b) For each i, W. (i) is a nondecreasing function on the interval [2£, oo) . 

(c) For any k,i>l such that £ < k/2, we have Wki£) > Wk+ii£+l). 

(d) For each fixed £, we have limfc_»oo Wk{£) — > 1. 

Proof. Note that 



oo 



w{k + j - £) 



j=Q 

^..i(^+i)=nfi+ "^'^'^ 

j=0 



w{k + j - £) 



(a) We need to show that Wk{£) > Wk{£ + 1) for all £ € [l,k/2]. By as- 
sumption (Al), we have 

w{k+j - £)w{£ + l)>w{k + j -£- l)w{£) for all j > 0, 
from which we get that, for all j > 0, 

^1 ^(^) "^(^+1) 



w{k + j-£)J ~\ w{k+j-£-l) 

(b) Here, we need to show that Wk{£) < Wk+i{£) for all k >l. By as- 
sumption (Al), we have w{k + j — £) < w{k + 1+ j — £) for all j > 0, which, 
together with (20), directly implies the above inequality. 

(c) Again by assumption (Al), we have w{£) < w{£ + 1) for all ^ > 1 so 
that representation (20) implies the claim. 

(d) This is an easy consequence of (6) using probabilistic interpretation 
(16) [equivalently, one can use the algebraic definition and (AO)]. □ 
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Corollary 8. Assume (Al). Then, for l<k/2, we have 
PiAt\Zk = i)<2P{Ai\Zk = i). 

Proof. Use (17) and (19). Note that 

w{k + w{£ + 1) < 2{w{k + + w{i)) 

for all k, due to assumption (Al), and that for each i > 1, the ith term 

w{e + i) 

w{i + i) + w{k - e + 1) 

in the infinite product of (14) is bounded above by the ith term 

w{k + i-e) 
w{i + 1) + w{k + i - £) 

in the infinite product of (13), again since (Al) holds. □ 

Therefore, to obtain asymptotic (in the sense of relation x) upper and 
lower bounds on P(T = k + 1), it suffices to study only 

k/2 

P{T = k + l,Ai) = Y^ P{Z, = l)P{Ai\Zk = i) 

£=1 

k/2 ^ 



implying the following result. 



Theorem 9. // (AO) and (Al) hold, and if P is P*^'^ for some fixed 
a,b> 1, then 

k/2 

Pl) F(r = *+I)xi;-^H',,.{«+1) 

and 



oo k/2 



k=n+li=l ^ ' 

Analogous statements are valid if P is P°-^^ ^ where W needs to be re- 
placed by W . Namely, assume that a and h are of opposite parity. Then, 
one shows in a similar fashion to Corollary 8 that for > a + 6 odd, we 
have P'''''(A^|Zfc =i)< 2P''^^{^Al\Zu = i), where A| is the event on which 
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the walk traverses the less (or equally) traversed edge at time k and the 
remaining (stronger) edge from time k + 2 onwards, and where A'^ = {T = 
k + 2}\ j4|. Combining this with Lemma 6, we obtain 



fc/2 ^ _ 



and 



oo 



k odd 

2.4. Examples. Let a,b>l be fixed integers and denote by P either of 
the laws P"'^ or P^'K 

Theorem 10. Suppose p> 1, let p' := {p-l)/p, a € (0, oo) and lete>0 
be arbitrarily fixed. 

(a) // w{k) = kP , k>l, then there exist finite positive ci{p),C2{p) such 
that for all k>l, 

'^<P{T = k + l)<p4. 
kP-P ~ ^ ' ~ kP~P 

(b) Ifw{k)=kPlog'^k,k>l,a>l, then there exist finite positive ci{a, p), 
C2{a,p) such that for all k>l, 

kP-p'log'^k- ^ kP-p' log" k' 

(c) // w{k) = /ce'°s , k > 1, 0<a<l, then there exist finite positive 
ci(a),C2(a) such that for all k>l and all e > 0, 

'-^ ^<PiT = k + l) 



fe(logA;)i-°ei°s" k-/3iog^- -fe 



< C2(«) 



k{logky-'^e^°s" fc-(Q+e)iog'^" -"k 

where (3 = a if < a < 2/3 and [3 = a — e otherwise. 

In particular, i/ < a < 1/2, then exp{— log^" ~" A;} x 1, so 

C2{a) 



P{T = k + l) 



fc(logA;)i-"ei°s" ^ 
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(d) Ifw{k) = e^" for some < e < 1, then there exist finite positive ci(e), C2(e) 
such that for all k>l, 



<P(r = A;+l) < 



where A;* = | - ^^^k^'^logk. 

(e) If w{k) =e"'^, t/ien there exist finite positive ci(a),C2(a) SMc/i that 



ci(a)e-°'^/2 < ^ ^ + 1) < C2(a)e- 



Remark. All of the constants of the form ci(-),C2(-) featuring in the 
statements above additionally depend on the initial weights a and 5, due to 
Theorems 4 and 9; for an example, see (26) below. 

Proof of Theorem 10. We concentrate on the case where P = P"'''; 
the other case, P = P°-^^ ^ can be treated similarly. Without loss of generality, 
we assume that (. < k/2. We are going to use the inequality 

(23) e-^'^'+^^S.-^ < w,+^{^ + l) < e-(^+^)i:r^. V2».(i-^)^ 
which is a direct consequence of the fact that 

e-^<(l + x)-^<e-^/^ 0<x<l. 
(a) For w{k) = k'\ (23) becomes 

e-(^+i)''Er=. VO-^)" < Wu+,{i + l) < e-(^+i)^i:r=. V(20-^)^)_ 

Using 

dx ^ I r°° dx 

k+i {x-i)p-f^^{j-l)p- Ik {x-l)P' 

we get a lower and an upper bound 

1 1 ^1 11 

(24) < V < 



p - 1 (A; + 1 - ^)P-^ ~ ^Aj ~ p-l{k- e.)P^^ ' 

]—K 

Therefore, we have, for 1 <i < k/2, 

^-(2P-^/{p-i))({e+i)p/kP-^) ^ ^_(i/(p_i))((£+i)P/(fc_^)P-i) ^ ^ 1) 

(25) < e-il/i2p~2))(ii+ir/{k+l^£)P-^) 

< ^-il/{2p-2))(lP/kP-^)_ 
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Now, Theorem 9 implies that 

(26) P{T = k + l)> c{a, b) ^ _J_.-(^''-'/(p-m{wr/kP-^) 



p 



>.(«,.).-<--/..-...l^ 

(27) ><;(<!,6)e-<^""/lf-'»*,-f'-', 

where c{a,b) is a finite positive constant. For the upper bound, again use 
Theorem 9 and (25). Now, note that, since k > 2i, 

k/2 k/2 

(28) V ^ ^-a/(2p~2)){ip/kp-^) ^ ^~{i/{2p~2WP/kP-^) 

^ ' ik-tjp ~\k)'^, 

£=kp' ^ ^ e=kp' 

To bound the last term above, we split the interval [k^ ,k/2] into subintervals 
of equal width k^ , with the last subinterval possibly having smaller width 
k/2 - \_k^-p' /2\kP' . To abbreviate, we define := [k'^'P' /2\. We then have 

k/2 



g-(l/(2p-2))(£P/fcP-l) 
l=kp' 

< kP'e'^^^'^P-'^'^ + k^'e-'^'/^'^P-'^'^ + ■■■ + kP' e~'"'''^^'^P~'^^ 

< F'[e"^/(2''"^) + e~2/(2p-2) + . . . + g-afc/(2p-2)j 

kP' 

< 



1 _ e-i/(2p-2) ' 

which, together with (28), completes the proof of part (a), 
(b) Using (23) and the fact that 

oo ^ 

§0--^)^log"(j-^) 

is up to a constant multiple of order l/((fc — £)p~^ log"(fc — i)), one obtains 
^-ci{a,p)i{e+i)p/(k-e} 

(29) <W^fc+i(^+l) 



^-ci{a,p){{e+i)p/(k-e)p-^)iiog"{i+i)/\og''{k-e)) 



< ^-C2{a,p){{e+l)P /kP-^){log" {£+!)/ log'' k) ^ 

where ci{a, p),C2{a, p) are finite positive constants. As in the case (a), one 
gets the lower bound by evaluating the order of 
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for ^ = 1, C = kf' and the upper bound by evaluating the order of the sum 
for ^ = 1, C, = kP and for ^ = kP , C, = k/2, separately, 
(c) We have 

dx ^ I r°° dx 



k+i (x - £)ei°g"(^-^) " (i - £)ei°g"(j-^) - Jk (x - £)ei°g"(^-^) 



Since 

dx 



k (x-^)ei°g"(^-^) 

log^-°(A:-^) l-a dx 



+ 



c,eiog-(fc-£) « (x-£)log"(x-£)ei°g"(^-^) 

log^-"(fc-^) ,^ , 

where Ofc(l) ^ as A; ^ cxo, using the fact that 1 < ^ < | above, we get the 
inequality 

, (logfc)^-" ^^ 1 giogA:)^-" 

j=fc ' 

for some ci(a),C2(a) G (O,cxo). By now applying (23), we obtain 

g-ci(a)(£+l)el°s"(*+i) log^-" fc/(el°s" 



<Tyfc+i(^ + l)<e 



-C2(a){^+l)el°g"(^+i) logi-" fc/{el°g" 



As in parts (a) and (b), we find a convenient breaking point and approximate 
the sums (30) separately. We take 



Q ^ glog" fc-log"' fc+/31og2«'— k I logl-a 



where /3 = aforO<a<2/3 and j3 = a — e otherwise. 

To verify the lower bound, we need to show that we can bound 



exp< —ci{a 



)(^ + l)eiog'^(C+i) 



log^-" k 

plog° k 



from below by a positive constant. Hence, we estimate (the constant c below 
is finite and positive, and possibly changes from line to line) 

(C + l)W-"fc . 

— — — explog C + 1 ) 

exp(log k) 

(31) <cexp[/31og2"'-"A;-log"'A:] 

X exp[(log" k - log"' k + 13 log^^^'"" k - {I - a) log log kf\ 
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<cexp[/31og^" -"A; -log" k 
< cexp[/31og2"'-" k - log"' k 



+ log"' k(\ - log"'-" k + /31og2"'-2° fc)"] 



+ log"' A;(l - a log"'-" k + /Jalog^"'-^" fc)] 

(32) = cexp(/31og2"'-" A; - alog2"'-" A: + /Jalog^"'-^" A;), 

where /3 is chosen as above and where, for the third inequality, we use the 
fact that (1 — xY < \ — ex for < x < 1 and < e < 1. Note, now, that if 
a < 2/3, then log^" -^" k is bounded from above by a constant, so /3 = a is 
sufficient to bound the expression (32) from above by a constant. If a > 2/3, 
then log^" -^" k ^ oo and 3a^ — 2a< 2c? — a, so taking /3 = a — e for any 
e > will suffice to bound (32) by a constant. By Lemma 7(a), VFfc_|_i(£ + 1) > 
VFfcH_i(C + l)>e-=', for£<C, so 



which proves the lower bound. 

For the upper bound, break the summation at the point 



^.^giog"fc-iog" fc+(„+,)iog^" ""^/log^-"A;. 
We have, since Wk+iii + !)<!, 

^1 ^ 1 c 

and since w{k — Q ^ 'w{k), we can bound this term from above by a term of 
the order stated in the formulation of part (c). Hence, it suffices to bound 

^k+i{^ + l)/w{k - i) as follows: 

k/2 k/2 



^ C2 f°° dx 



(34) 



^glog^fc gC2(a)xel°g"='logi-"fe/ei°s"fc 

C2 e'°s" 



^giog^fc logi-" A:(l + alog"-HC))ei°s"(^) 
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where the last term is obtained by integration by parts. 
First, estimate 

C-log^""A: „ 
exp(log-fe) ^"P^^°g 

= exp[(a + e) log^"'"" k - log"' k] 

X exp[(log° k - log"' k + {a + e) log^"'"" A; - (1 - a) log log kf] 

> cexp[(a + e) log^"""" k - log"' A; + log"' k{l - log"'"" fe)"] 

> cexp[(a + e) log^"'"" k - log"' yfc 

+ log"' k{l-{a + e) log"'-" A;)] > c', 

where, in the last inequality above, we used 

(35) (1 -x)" > 1 - (a + e)x, e>0,x^O. 

Therefore, we can bound the multiple (34) from above by a constant c. 
Furthermore, 

C2 e^°s" ^ 



fcei°s"^ log^-"fc(l + alog"-^(C))ei°g"(^) 

C2 exp{-(log" - log"' k + {a + e) log^"'-" - (1 - a) log log A;)"} 



< 



< 



A;(logA;)i-° 
C2exp{-(log"A:-log"'fc)"} 



A;(log k) 



^ C2 exp{- log"' A;(l - (g + e) log"'-" k)} 
k{\ogky-^ 

where, in the last inequality above, we again used (35). 
(d) We have 

dx ^1 dx 
< > ^ < 



Note that 

1"^ dx _ {k-iy-^ l-€ dx _ {k-iy-' 

where, again, Ofc(l) — > as A; — > oo. From the above formulae, we obtain the 
inequality 

(36) -2(e)^^^^ ^t^< 

^ j=k-i ^ ^ 
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for some ci(e),C2(e) S (0, oo). By now applying (23), we obtain 

(37) ^-cA.)e^\^-if-^le(^-'^'- < ^^^^^(^ + 1) < g-c.(.)e^^(fe-£)-Ve('=-*)' . 

If we now take k* = ^ — ^^^^k^~^\ogk, then 

Wk+i{k* + 1) > e--iW^'^-"(^-^*)^"Ve('=-'=*'\ 

Note that 



k*' - {k - k*Y = {k - k*) ' ' 



^ (l-e)A:^-^logA: y ^ 
e2^-^{k-k*) 



< -(1 -e) logk + 0{k- 



where the last inequality is obtained using (1 — xY < 1 — ex for < x < 
1 and < e < 1, together with k - k* >k/2{l + 0{\ogk/¥)). Therefore, 
liminffc Wk+i{k* + 1) > and, by Lemma 7(a), 

Wk+i{l + 1) > Wk+i{k* + 1) > c(e), £ < r for some c(e) > 0. 

Therefore, recalling ci(e),C2(e) from (36), 

■ ci{e){k - k*Y-' C2(e)fci-^ 



>c(6) 



* \l—e 



^ c{e)c,{e){k-k*) 
- f,{k-k*y ' 

where the constant c(e) may change from line to line by a positive finite 
multiple. This proves the lower bound. 

To get the corresponding upper bound, first observe that Wk+i{i+ 1) < 1, 
so, using (36), we can simply bound 

E^r-^w^^+i(^ + i)< E -T^<^2(^) k*L 
fr{ w{k - q j=t^fc* "^u) ' 

and we proceed to bound I]^=l;* ^)(fc-£) ^fc+i(^ + !)• 
Due to (36) and (37), we can write, for i G [k*,k/2], 

exp(^-c[ie)w{i) l^°°^^^<Wk+iii + l)<exp!^-c',ie)wii) ^} 

(38) 
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for some c']^(e), c'2(e) G (0, oo). Since Wk+i{k* + 1) x 1, as we showed in the 
proof of the lower bound, we have 

1 r°° dx 



w{k*) Jk-k* e^' 

and since 

CO flj. POO i-lj. 

k-i Jk-k* 
we conclude from (38) that 

Wfc+i(£ + l) <exp{-cu;(£)/u;(r)}, £(^[k\k/2]. 

Therefore, 

where c € (0, oo) is such that e~^^ < cx~'^ for all x > 1 and where we use 
the fact that w{tj > w{k*) for i>k*. Finally, it is easy to check that i i— > 
^^(A; — i)w{£), £>k*,isa nondecreasing function, so 

w{k*) ^ 1 



w{i)w{k-i) - w{k - k*) 
and therefore 

^ W'^jk*) ^ W{k*) ^ J_ ^ W{k*) dx 

^tfc. w'^{^)w{k -i) ~ w{k - k*) w{£) ~ w{k - k*) Jk*-i w{x) 
< C2 e 



w{k — k*) ' 



which gives the upper bound, due to the fact that k* <k/2 < k — k* . 

(e) This is a direct consequence of part (d), but its direct proof (left to 
an interested reader) is much easier. This fact is related to the following 
property: among all of the weights in (d), it is only the case of w{k) = 
where the edge-reinforced random walk gets attracted at any particular time 
with probability uniformly bounded away from zero. □ 

As a consequence of Theorem 10, we now have the following. 

Corollary 11. Suppose that w{k) is as in (a) or (b) in Theorem 10. 
Then, E{T) is infinite if p<l + and finite if p>l + . 
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3. Analysis on general graphs. Assume that Q is a connected graph with 
D{Q) < oo. Recall that is the law of the reinforced random walk on Q. 

We start with an easy lower bound in terms of the tail distribution of T 
under the two-edge law P. In fact, in the following comparison arguments, 
it will be convenient to instead consider the law of 

(r)+ = r+ ■=T-to. 

Unless otherwise stated, in this section, we will assume that Iq, e € EiQ), 
forms the (general) initial configuration of weights on edges such that Iq < 
oo, e£E{g). 

Lemma 12. There exist c = c{w, 'D{g)) € (0, oo) and a, 6 € N such that 
P^{T+ >k)> cP''^\T+ > k). 

Proof. Let ItQ = v he the initial position. Without loss of general- 
ity, assume that at least two edges e and / meet at v. Otherwise, at least two 
edges must meet at the unique neighbor of v and the argument is similar. 
Recall that Qi denotes the range of the walk. Define the event 

^ej ■= {Gi C graph spanned by e, /} 

and note that, due to (AO), event Agj has positive probability for any given 
bounded degree graph and any fixed configuration ^g, e E E[Q). At the same 
time, 

{r+>A;}n^e,/c{r+>fc}. 

Denote by Ve and Vf the two vertices such that e = {v^Ve} and / = {v^Vf}. 
We will verify below the existence of a positive constant [3 that depends 
on Q^w and the initial weights, such that for each (possibly infinite) path 
t; = -io ~ • ■ • of vertices where i„ G {f , Ve,Vf}, n > 0, we have 

(39) P^{It, = io, It,+i = ii,...)> (/to = ^0, Ito+i = . . .)■ 

f — e f 

Note that to equals ^Q'^o under the law P^o'^o, but as mentioned earlier, the 
edge-reinforced random walk can be redefined by a time-shift to start from 
any fixed initial time and this does not change the probability of it taking 
any particular path. Clearly, (39) implies that P^{BnAej) > l3P^oA{B) 
for any event B in the cr-field generated by the walk. In particular, 

p^(r+ >k)> p^{{T+ >k}n A^j) > /3P"'*(r+ > k), 

as claimed. 
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It suffices to verify (39) for each infinite path ~ • • • specified above. 
For n > to, define := £q + #{j < n : = e} and xf^ := Iq + #{j < 

n : = /}. The probabihty on the right-hand side of (39) equals 



^{«2n,«2n + l} 

(40) n 



n=0 ^(2;f(,+2n) + '"^(^io+2n) 

Define 

civ) := Y: ^i^o'^h 
The probabihty on the left-hand side of (39) equals 

TT '^l-^to+2n ) TT '^'-■^fo+2n+l ) 

iio «^K+2n) + «^(<+2n) + c(.;) ^i) «;(4o+"2"^.^4^r + c(«{.2„+l .2„+2} ) ^ 

(41) 

where the first infinite product accounts for all the steps originating from 
the middle vertex f , while the second infinite product accounts for all the 
steps originating from the "boundary vertices" Ve and Vf. Since 

c(^{»2n+i.»2n+2}) c{ve)yc{vf) ^ ^ 

n7/)rT^*^"+^''^"+^h -^r('?;r- i^l ~ nWin) + (c(Ve) /\c(vf)) 

by (AO), a well-known calculus fact implies that the second product is uni- 
formly (over infinite paths) bounded away from 0. The ratio of the first 
product in (40) and the probability in (42) is again uniformly bounded away 
from since 



civ) / o '^(^) 



< CXD. 



t'o wK+2n) + «^(4+2n) + civ) fo «'(^) + ^(^) □ 

Getting a corresponding upper bound on the tails of the distribution of T 
seems more difficult. As a warm-up, we study the tree setting next, and the 
general finite graph and infinite graph settings, respectively, in the following 
subsections. 

The following fact, complementary in spirit to conditioning on event A^j 
in the proof of Lemma 12, will soon prove useful. 

Lemma 13. Suppose that Q* is a finite connected subgraph ofQ. Then, 
for each (possibly infinite) path ~ ~ • • • of vertices all contained in Q* , 
we have, assuming P^iho =io) = P^* iho = ^o) = 1> 

P^iho =ioJto+i = h,---) <P^*iIto =ioJto+i = ii,---)- 
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Proof. At each step k where all the neighbors of the current position 
ik are contained in Q* , the probability of the transition from ik to ik+i is 
the same under both laws and . 

At each step k where at least one neighbor of the current position ij. is 
an element of V{Q) \ V{Q*), note that the probability of the transition from 
ik to ik+i under P^ is strictly smaller than that under P^ . □ 

3.1. Analysis on trees. In this subsection, we assume that ^ is a tree 
such that D(Q) < oo and we derive some upper bound estimates on the tail 
distribution of T under P^ . 

First, let Q be the star with m fingers, as defined in Section 2.2. For the 
sake of concreteness, we assume that all of the initial weights Iq^ are equal to 
1 and that /t,j = /m = 0. A similar statement applies for more general initial 
configurations. 

Lemma 14. P^{T+ > k) < (^)pi'HT+ > k/Q). 

Proof. We will show that 
(43) r+ < T"-^^''''^**'^'+, almost surely, 

where J"="<=i''"6«*'" = 'j'ej,e^, restr -g ^ random variable to be defined, correspond- 
ing to the pair of edges , Cj such that its law under P^ is the law of T under 
pi'^ and where T'=-<=^''^^'^*'''+ = (^^i.e.■.^e.^r^j+^ r^^^ reason for (43) is as follows. 
Suppose that / G {ei, . . . , e^} is the attracting edge for the walk. The steps 
away from the central vertex up to time T are naturally split into Kf^ steps 
traversing edge e 7^ / (so, in total, there are 2Ke steps along any e 7^ /). Up 
to time T, there are therefore T — 2J2eT^f ^^^P^ across /. For e^ f, define 

y*^'-^ := time of the last traversal of e 

and 

T^'^ := £q + £q + ^traversals of e or / up to time n, 

r^'^'+:=r„^'/-(£U4). 

Recall the time-line construction of Section 2.2 using m independent "time- 
lines" (one corresponding to each edge). 

Now, fix arbitrary edges e and g. By ignoring all of the time-lines except 
the ones corresponding to edges e and g, one obtains the construction of the 
reinforced random walk under the law P^'^. Call this process the restriction 
to edges e and g. Define 

rpe,g,restr ._ ^jj^g q£ attraction for the restriction to e and g 



28 



C. COTAR AND V. LIMIC 



and 

rpe,g,restr,+ rpe,g,restr _|_ 

In particular, T'^'9,'restr,+ ^j^der has the law of T"^ under P^'^. Next, 
observe that in the case where g = f \s the attracting edge, we have 

(44) r^J.'-e^f^ = r^'/^. + 1 and T^'^'^^**^'+ = r^'£>+ + 1, 

where the extra 1 on the right-hand side accounts for the traversal of edge 
/ at the attraction time J''^./-''*^^*''. in addition, note that for each e 7^ /, the 
number 2Kf^ of steps traversing e before time T equals the number of steps 
traversing e before time Tpf j. By similar reasoning, the number of steps 
traversing / strictly before time T equals the number of steps traversing / 
before time T^'// , for at least one g ^ f (to be precise, g is the edge traversed 
at time T — 1). The last two claims imply that 

(45) T+< 5] r^'/^+ + l, 

e:e^f 

where, again, the extra 1 accounts for the traversal of / at time T. By (44), 

^ Tyi'j^ + 1= (r^'^'''''*'^'+ - 1) + 1 < ^ T^'^ 

e:e^f e:e^f e,g:e^g 



so (45) implies that 

(4g) 2^+ < - ^ rpe,g,restr,+ ^ 



in particular, yielding (43). As noted already, the (^) different random vari- 
ables T'^^9,i"(istr,+ g^j^g (identically) distributed under the law as is under 
the law P^'^. The statement of the lemma is now a standard consequence of 
(43). □ 



Now, consider a finite tree Q. Let m{G) be the total number of pairs of 
edges in Q that meet at a vertex. For example, the star with m fingers has 
m{Q) = C^). Using the same reasoning (for each v, consider separately the 
star created by restricting the tree to v and all u, it ~ u) as in Lemma 14, 
one quickly obtains the following. 



Lemma 15. Assume that = 1, e e E{Q). Then, 

P^{T+ >k)< m{g){P^'^iT > k/m{g)) + P^^'^{T > k/m{G))). 
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Here, P^''^(T > k/m{Q)) appears due to parity considerations. Namely, 
for any two edges e, / that meet at a vertex v, say, at the first time the walk 
visits V, the configm'ation of weights is either 1, 1 or 1, 2 or 2, 1. 

We will soon show analogous results for the walk on a general finite graph. 
Before this, we quickly turn to the case where Q is an infinite tree of bounded 
degree. Recall that jj^Qi denotes the total number of vertices ever visited by 
the edge-reinforced random walk on Q. Here, again, we assume that £q = 1, 
e € E{Q). The next lemma can be proven in an analogous (but simpler) way 
to Lemma 25; we leave its verification to an interested reader. 

Lemma 16. There exists p> 0, depending only on the weight w and the 
degree D[Q) of Q, such that j^Qxjl is stochastically bounded by Z, where Z 
is a geometric random variable with success probability p. 

Corollary 17. Let Q be an infinite tree such that D{Q) < oo. Then, 
for any c> 1, we have 

> ^) ^Q( ^clo,a/(i-.))/. ) + maxP^-(T- > fc), 

where the above maximum is taken over all trees Q^^c having fewer than 
cD{Q)\ogk vertices and degree bounded by D{Q). 

Proof. Due to the last lemma, with probability (1 — p)(ci°g'=)/2^ the 
range Qi of the walk is a subtree of Q containing initial position It^ and 
clog A; or more vertices. On the opposite event, denoted by -Be log fcj we have 
Gi C ^ciogfci where G*\ogk ^ (nonrandom) subtree of Q generated by all 
vertices v olQ such that the graph distance of v and It^ is less than or equal 
to clog/c. Therefore, by Lemma 13, we can bound 

pH{t+ > A:} nSeiogfc) < P^({r+ >k}n {Gi c g^i^g J) < p^c*iog.(T+ > k)n 

Corollary 18. Let Q be an infinite tree of bounded degree and let w{-) 
be as in the examples of Theorem 10(a) -(b). Then, 

pQ{T > k) = P^'\T > k)0{log'Jk) 

for any q> p — p' . 

Proof. For any tree Qk,c of bounded degree with fewer than 0(logA;) 
vertices, one also has ?7T.(^fc c) = 0(logA;). Use the previous corollary with 
clog(l/(l — p))/2 > p — p' — 1. Finally, note that under the assumptions of 
Theorem 10(a) [resp., (b)], m{Gk,c)P^'^{T~^ > k/m{Gi: c)) is of order log/c • 
pi'i(r+ > k){logk)P^p'~'^ [resp., logk-P^^^T+ > k){logk)P^p'~\loglogk)'']. 
□ 
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3.2. Analysis on finite graphs. Assume that (AO) holds. Let be a fi- 
nite graph and let n= \E{Q)\. Moreover, denote the edges of Q by E{Q) = 
{ei,e2, ■ ■ ■ ,en}- If v is an arbitrary vertex of the graph, let n„ = degree(?;), 
and let Mv ■= {e^, 62, • • • , ej^^} be the set of edges incident to v. Recall that 
equals the initial weight if^ incremented by the number of times that 
edge e has been visited by time k. 

As before, we will start the walk at time J2e&E{g) ^o- initial position 

ItQ at some arbitrary vertex vq. The following proposition then holds. 

Proposition 19. Let k > J2eeE{g) ^0 '^"■^ ^ ^(^); ^'^^ denote by A^^k 
the event {/^ = v}. Then, for any , e G such that > ^ ^ ^(S) 

and J2e€E{g) = k, we have 

(47) PHXl = t,eeEigiA^,)< """^^^ "^g. • i^^^^^ "^flV 

mmeeAT^o w{tQ) Y{e&E{g) ^(^ ) 

Remark. Inequality (47) holds trivially when the conditions of the 
propositions do not hold, since the left-hand side then equals 0. 

Proof of Proposition 19. As in the two-edge case, we will use in- 
duction on i'^ = k to prove the above inequality. The base of induction 
at the initial time J2e ^0 clearly holds since, when the left-hand side is 0, the 
right-hand side is positive and when the left-hand side is 1, the right-hand 
side is greater than 1. 

Now, take k > X^e ^0 consider the event on the left-hand side. For each 
i = 1,2, ... ,ny, let Vi S V{Q) be the neighbor of v such that = {v,Vi}. 
In order for the event {X^ = i^,e G E{Q),A^^ii.} to occur, we must have 

Ik-i = Vi for some Vi^ v such that ^^^'^'J' = > and, furthermore, we 
must have {Ik-i,Ik} = e^. Therefore, 

P^{Xl = e,eeE{g),A,^k) 

= Yl P^{Xt_, = t,^e^e^„XlL, = t^ - l,^,,fc_i) 

^=l,f^ >y 

W{£^^ - 1) 



1«(£^« -l)+Ee^er6Ar„,^(^^) 

Similarly to Propositions 2 and 3, the proof follows immediately by induc- 
tion. □ 

From now on, denote by 

IleeE(g)wi^o) 



wo{n) :-- 



mineeAT.o w(^;^) 
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the constant (ensuring appropriate scale-invariant behavior with respect to 
w) from the above proposition. 

Define Si{k) := l/w{k), k>l, and for each n > 2 and k > n, define 

(48) Sn{k):= ^ \ --, 

where the indices ii, i = 1, . . . ,n, in the above summation are ah greater than 
or equal to 1. If A; < n, simply set Sn{k) := 0. Then, note that for k>n>2, 

Sn{k) = -^Sn^lik - 1) + -^Sn-l{k - 2) + • • • 

w[l) w(2] 

(49) ' ' ^ 

+ Mfe-n + l)^""^("-')- 
Subsequently, we will make use of the following assumption on w{k): 

k-i . r ^ 

^ ' j^^w(i)w(k-i)- w(\) w(ky - ' 

where < 00 depends on w(-) up to scaling. 

Remark. The examples of Theorem 10(a)-(c) all satisfy (A2). 

The next lemma will be useful in deriving Corollary 22 below. 

Lemma 20. // (A2) holds, then, for all k>n>2. 



Sn{k) < 



{w{l)y'w{k)' 



Proof. We prove the statement inductively. The case n = 2 is a direct 
consequence of assumption (A2). Suppose that for some n > 2 and for all 
k>n,we have Sn{k) < . Then, assumption (A2) and identity (49) 

imply, together with the inductive hypothesis, that for each k>n + l, 

^- {w{l)rfr{w{j)w{k-j) - {w{l)y+^w{k)- □ 

The next result is in the spirit of Lemma 6. It applies in the following 
setting: fix three different vertices uj,v and u such that w ~ u and v ^ u. 
Recall the notation from the beginning of this section. Furthermore, we 
assume, without loss of generality, that 

(50) e\ = e't = {u,v}, = el = {lo,v}. 
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Assume that = q, = p and nu = m (recall that these are the degrees 
of the corresponding vertices). We introduce the following notation, to be 
used in the next theorem: 

P^{uj,u,v;k) := P^{Ik=uJ,Ik+2i+i = v,h+2i+2 = u,i> 0). 



Theorem 21. In the setting of Proposition 19, we have 
P^{lo, u, v; k) 



e'' ' 



oo 



(51) X [] w{t'"^ + 2i)/{w{t'^ + 2i) + w{t^2 + 1) 

+ W{t^ + ■ ■ ■ + W{tv)) 



oo 



f}^ w{ri + 2z + 1) + wii''^) + ■■■ + w{i^^) ■ 

Proof. This is a direct consequence of Proposition 19 and repeated con- 
ditioning. Namely, given a particular configuration of weights £^,e € E{G), 
(47) estimates the probability for the walk to realize this configuration at 
time k and to end up at vertex uj at time k, the probability of the next step 
is 

w{e^")/{w{t^) + ■■■ + w{t^)) = w{r^2)/{w{t") + ■■■ + w{t^)) 

and that of the infinitely many steps, each traversing {v, u}, is given by the 
two infinite products in the statement. Note that we have made use of the 
notation (50). □ 



There are various ways to simplify (and lose precision in doing so) the 
above bound. We chose a particularly simple one for the purposes of illus- 
tration since we could not find a good enough simplification that would 
"eliminate" the exponential term in the size n of the graph in Corollary 23 
below. From now on, assume that both (Al) and (A2) hold. 

Note that we can bound the sum (51) by 

(52) 2. fTTTT^-ll 
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Next, rearranging (52) according to the value 5 = ^*^1+ yields [recall 
definitions (48) and (15)] 

{uj, V, u; k) 

<wo{n) Sn-2{k-s)Y,— -Ws+i{j + l) 



(53) 



/ li« 2 



k-1 
s=2 


s-1 

i=i 


k-1 

Y.Sn-2{k 

s=2 


s-1 

i=i 



^1 ^i^(s - j) 

1 



^ W^s+l(j + l) 



W^fc+i(j + l) 



where, for the very last inequality, we used (Al), which implies W s+i{j + 
1) < WkJ^i{j + 1), as in Lemma 7(b). Interchanging the order of summation, 
applying Lemma 20 and (A2) now gives 

pg, ,,^ ^)o(n)(C^)^-^ ^^^ 1 1 TT7 r^n 

and, in turn, 

which, comparing with the expression for in Lemma 6 and accounting 
for various possibilities of parity, finally implies that 

a,fee{l,2} 

where wi € (0, 00) accounts for the "x" equivalence of Lemma 6. 



Remark. It will be convenient for the comparison arguments in the 
next corollary to refer to P"''', even when a and b are of the same parity. 
In this case, the reader has an option of either noting that the parity does 
not influence the arguments for Theorem 4, Lemma 6 and Theorem 10, or 
noting that if a — 6 is an even number, then the law P"'^ with reinforcement 
weight w corresponds to the law P"''' with reinforcement weight w, where 
w{a + j) = w{a + 2j), j>0. 
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Corollary 22. Assuming (A0)-(A2), we have 

^'^^^)) a,fee{l,2} 

Proof. Sum over all possible choices of vertex v, edge {n, v} and neigh- 
bor Lo of V, and note that there are at most 2nD{Q) terms of type (a;, v, u; k) 
contributing. □ 

Corollary 23. Assuming (A0)-(A2) and t = I, for all e G E{Q), we 
have 

P^{T = k + l)<2winD{g){C^f-^ P^'\T = k + l). 

a,fee{l,2} 

As noted earlier, the examples (a)-(c) from Theorem 10 satisfy (A0)-(A2). 
In particular, Corollaries 11 and 22 now imply the following. 

Corollary 24. Let Q be a finite graph. Suppose that w{k) is as in (a) 
or (b) in Theorem 10. Then, E^{T) is infinite if p<l + and finite if 

The examples (d)-(e) of Theorem 10 do not satisfy (A2). Here, one could 
use (53) with separately derived bounds on Sn{k) to obtain bounds on 
P^{T = k + l), as in Corollary 22. In particular, if w{k) = e^^ , e € (0, 1] , then 
Sn{k) < {^Z.\) /w{k) and the above reasoning, together with Theorem 10(d), 
gives 

(54) p0^T = k + l) = O{k'^)j^, 

which is P^'^(T = k + 1) up to a polynomial correction. 

3.3. Extensions to bounded degree graphs. Let Q be an infinite graph of 
bounded degree and, as usual, let assumption (AO) hold. We wish to estimate 

Pi#Gi>k), 

where we recall that i^Qi denotes the number of vertices in the range of the 
walk. Since D{g) < oo, note that the above estimate will imply an estimate 
on P(jC?ij >fc). 

Lemma 25. The random variable ij^Qi is stochastically bounded by 2 - Z, 
where Z has geometric distribution with success probability p € (0, 1), where 
p depends only on w{-), D{Q) and the initial configuration of weights £§,6 G 
E{Q). 
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As a consequence, we obtain that whenever Q has bounded degree, both 
i^Gi and \Qi \ have exponential tails. 

Proof of Lemma 25. We will construct a couphng of Qi and Gt such 
that Qi CQI, almost surely, and such that the claim of the lemma holds for 
Q*. Denote by Ty the time of the first visit to the vertex v of Q, where is 
infinite if the walk never visits v. If {T^ = n}, then either: 

(i) at least one neighbor v' of v has not been visited by the walk before 
time n; or 

(ii) all the neighbors of v were visited by the walk up to time n. 

First, suppose that case (i) happens. Then, "add" to QI both vertices v 
and v' , as well as the just-traversed edge leading to v and the edge {v,v'}. 
Due to the assumptions, with probability p, uniformly bounded away from 
and depending only on D{Q), w{-) and 1^,6 S E{Q) (in fact only Iq on edges 
/ incident to v'), the walk keeps traversing solely the edge {v,v'} after time 
n. In symbols, on the event of case (i), 

^^({4, 4+1} = {v, v'},k > n\J^n) > P- 

If the above event {Ik,Ik+i} = {'^Tv'},k > n, does not occur, then the walk 
will keep exploring the graph elsewhere. Either it will get attracted to an 
edge before encountering another new vertex or it will encounter another 
new vertex prior to getting attracted. 

If the case (ii) happens, note that QI already contains vertex v. Namely, 
let u be the neighbor of v such that 

Tu = max Tyi < Ty . 

Then, v must have been added to QI as part of the case (i) procedure, before 
or at time T^. 

Therefore, Qi CQ*, almost surely, by induction. Moreover, from the con- 
struction, it is clear that #Qi is stochastically bounded by 2Z. □ 

As a conclusion, we offer the following weak universality-type result. 

Corollary 26. Assume that t = 1 for all e € E(Q). If w{k) = k^, 
p> I, then there exists p > such that P^{T > k) < 

Proof. We use the idea of Corollary 17, together with the previous 
lemma and the bound of Corollary 23. Namely, we split the event {T > k} 
according to whether or not the walk reaches distance from Iq. Choose 
4 = clog A:, where c is such that (C^„)^'°s'= < kP'P'-'^. □ 
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Remark. If w{k) = e'^, then the walk gets attracted at any particular 
step with probability bounded away from 0, so there exists c > such that 
P^{T > k) = 0{-^). Somewhat disappointingly, the bound of type (54) is 
too weak to provide an alternative derivation (analogous to the proof of 
the last corollary) of the above bound. Indeed, the question of finding the 
exact (up to a multiplicative constant) behavior of the tail distribution of 
T on general bounded degree graphs, even in the case of the examples in 
Theorem 10, remains open. 
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